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IN THE CLAIMS; 

The text of ali pending claims, (including withdrawn claims) is set forth below. Cancelled 
and not entered claims are indicated with claim number and status only. The claims as listed 
below show added text with underlining and deleted text with sfr i k e tfomugh . The status of each 
claim is indicated with one of (original), (currently amended), (cancelled), (withdrawn), (new), 
(previously presented), or (not entered). 

Please CANCEL and AMEND the claims in accordance with the following: 

1-18. (CANCELLED) 

19, (CURRENTLY AMENDED) A control system for controlling a display device 
including a display unit displayin g a motion picture, and a pointing unit pointing a position on the 
motion picture, said control system comprising: 

a recognizing unit recognizing an o b ject in the motion picture on which the pointing 
manipulation is effected; and 

a processing unit executing a predetermined process related to the object recognized, 
where said processing unit, 

wherein said processing unit, when the object is recognized from the pointing 
manipulation during the display of the motion picture contained in the first data, commands said 
display device to effect a first changeover to an output of the second data related to the object, 
said processing unit commands said display device to execute a second changeover to display 
the motion picture after outputting the second data, and 

Acont f o i- sy s t em-a ccord i ng to cla i m 18, wherein said display device further includes a 
recording unit recording data, and said processing unit, after outputting the second data, issues 
a command of displaying the motion picture from a point of the first changeover recorded on 
said recording unit. 

20. (CANCELLED) 

21 , (ORIGINAL) A control system for controlling a display device including a display 
unit displaying a motion picture, and a pointing unit pointing a position on the motion picture, 
said control system comprising: 

a communication unit transmitting the position on the motion picture receiving the 
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pointing manipulation to a server including a unit recognizing an object in the motion picture 
receiving the pointing manipulation, and receiving, from said server, information on the object in 
the motion picture recognized by said server; and 

a processing unit executing a predetermined process related to the object recognized, 

22. (CURRENTLY AMENDED) [[A H The control system according to claim 21 , 
wherein said display device further includes a receiving unit receiving data, 

wherein said receiving unit receives first data containing the motion picture, and second 
data related to the object in the motion picture contained in the first data, and 

said processing unit makes said display device output the second data related to the 
object recognized. 

23. {CURRENTLY AMENDED) [[A II The control system according to claim 22 7 
wherein the second data contains an image related to the motion picture of the first data. 

24. (CURRENTLY AMENDED) [[A IIThe control system according to claim 22, 
wherein the second data is multiplexed with the first data and thus distributed. 

25. (CURRENTLY AMENDED) [[A II The control system according to claim 24, 
wherein the first data is constructed with a predetermined data structure and the second data is 
embedded in a margin formed in the data structure of th e f i r -st-data. 

26. (WITHDRAWN) The control system according to claim 21, wherein said 
processing unit executes an application program related to the object recognized, 

27. (WITHDRAWN) The control system according to claim 21 , wherein said 
processing unit executes a task related to the object recognized, 

28. (WITHDRAWN) The control system according to claim 21 , wherein said 
processing unit commands other task executing device to execute a task related to the object 
recognized via said communication unit 
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29. (CURRENTLY AMENDED) A con t rol-sy stem according to cla i m 21 , A control 
system for controlling a display device including a display unit displaying a motion picture, and a 
pointing unit pointing a position on the motion picture, said control system comprising: 

a communication unit transmitting the position on the motion picture receiving the 
pointing manipulation to a server including a unit recognizing an object in the motion picture 
receiving the pointing manipulation, and receiving, from said server information on the object in 
the motion picture recognized by said server; and 

a processing unit executing a predetermined process related to the object recognized, 

and 

wherein said display device includes a reproducing unit reproducing the motion picture 
recorded on a recording medium, 

said recording medium is recorded with a first motion picture and a second image related 
to an object corresponding to the first motion picture, and 

said processing unit makes said reproducing unit reproduce from said recording medium 
the second image related to the object recognized and makes said display device display the 
reproduced second image. 

30. (WITHDRAWN) The control system according to claim 21 , wherein said server 
further includes a unit transmitting an information to an add-up device adding up the pieces of 
information, and 

said processing unit notifies said server of the information on the object recognized via 
said communication unit, and makes said add-up device add up results of the recognition via 
said server. 

31 . (CURRENTLY AMENDED) [[A H The control system according to claim 21 , 
wherein said display device further includes a reproducing unit reproducing the motion picture 
recorded on recording medium, and 

said communication unit , when the motion picture to be reproduced receives the 
pointing manipulation, transmits, to said server, information for specifying this motion picture and 
information for specifying a position where the pointing manipulation is effected on the motion 
picture. 
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32. (ORIGINAL) A server in linkage with a display device including a receiving unit 
receiving data containing a motion picture, a display unit displaying the motion picture, and a 
pointing unit pointing a position on the motion picture, said server comprising; 

a communication unit receiving information on the position where the pointing 
manipulation is effected from said display device; 

a recognizing unit recognizing the object in the motion picture receiving the pointing 
manipulation on the basis of the information received from said display device; and 

a processing unit executing a predetermined process related to the object recognized . 

33. (CURRENTLY AMENDED) [fAI IThe server according to claim 32, wherein said 
processing unit transmits the information on the object recognized to said display device via said 
communication unit. 

34. (WITHDRAWN) The server according to claim 32, wherein said processing unit 
executes a task related to the object recognized. 

35. (WITHDRAWN) The server according to claim 32, wherein said processing unit, 
via said communication unit, commands other task executing device to execute a task related to 
the object recognized. 

36. (WITHDRAWN) The server according to claim 32, wherein said communication 
unit notifies an add-up server adding up pieces of information, of the information on the object 
recognized, and makes said add-up server add up results of the recognition. 

37. (WITHDRAWN) The server according to claim 32, wherein said communication 
unit communicates with an E-mail server delivering an E-mail, and 

said processing unit, via said communication unit, commands said E-mail server to 
deliver an E-mail related to the object recognized. 

38 (ORIGINAL) A server issuing a command to a data distribution system in linkage 
with a display device including a receiving unit receiving data containing a motion picture from a 
data distribution system, a display unit displaying the motion picture, and a pointing unit pointing 
a position on the motion picture, said server comprising: 
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a communication unit receiving information on the position where the pointing 
manipulation is effected on the motion picture from said display device; 

a recognizing unit recognizing the object in the motion picture receiving the pointing 
manipulation on the basis of the information received from said display device; 

a referring unit referring to an instruction related to the object; and 

a commanding unit commanding said data distribution system to change over the data to 
be distributed in accordance with the instruction. 

39-60. (CANCELLED) 

61 . (CURRENTLY AMENDED) A storage medium readable by a machine, tangible 
embodying a program of instructions executable by the machine to control a display device 
including a display unit displaying a motion picture and a pointing unit pointing a positi on on the 
motion picture, com prising: 

IggggDiMo.g,..g n object in the motion picture on which the pointing manipulation is effected; 

and 

executing a predetermined process related to the object recognized, 

wherein said predetermined process involves, when the pointing manipulation occurs 
durin g the display of the motion picture contained in the first data, commanding said display 
device to output, after an end of displaying the motion picture, the second data related to the 
object recognized by the pointing manipulation, 

A storage medium r e adabi e by a m a Gh i n e 4 a ^b le - e mb e dying a program accord i ng to 
c la im SO, where i n said display device further includes a recording unit recording the data, and 

said predetermined process involves, when the object is recognized from the pointing 
manipulation during the display of the motion picture, commanding said recording unit to record 
the second data related to the object, and commanding said display device to output after the 
end of displaying the motion picture, the second data recorded. 

62. (CANCELLED) 

63. (CANCELLED) 
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64. (CURRENTLY AMENDED) A storage medium readable by a machine, tangible 
embodying a program of instr uctions e xecutable by the machine to control a display device 
including a display unit displaying a mot ion pictureand^Bointln a unit pointing a position on the 
motion pic ture, comprising: 

recognizing a n ob ject in the motion picture on which the pointing manipulation is effected; 

and 

executing a predetermined process related to the object recognized, 
wherein said predetermined process involves, when the object is recognized from the 
pointing manipulation during the display of the motion picture contained in the first data, 
commanding said display device to effect a first changeover to an output of the second data 
related to the object said predetermined process involves commanding said display device to 
execute a second changeover to displaying the motion picture after outputting the second data r 
and 

A storage med i um readab l e by a machine tang i b l e e mbody i ng a program accord i ng to 
claim 63, wherein said display device further includes a recording unit recording data T and 
said predetermined process involves issuing a command of displaying, after outputting the 
second data, the motion picture from a point of the first changeover recorded on said recording 
unit 

65. (CANCELLED) 

66. (ORIGINAL) A storage medium readable by a machine, tangible embodying a 
program of instructions executable by the machine including a communication unit so as to 
control a display device including a display unit displaying a motion picture and a pointing unit 
pointing a position on the motion picture, to perform method steps comprising: 

transmitting the position on the motion picture receiving the pointing manipulation to a 
server including a recognizing unit recognizing an object in the motion picture receiving the 
pointing manipulation; 

receiving, from said server, information on the object in the motion picture recognized by 
said server; and 

executing a predetermined process related to the object recognized, 
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67. (CURRENTLY AMENDED) [fAllThe storage medium readable by a machine 
tangible embodying a program according to claim 66 t wherein said display device further 
includes a receiving unit receiving data, 

said receiving unit receives first data containing the motion picture, and second data 
related to the object in the motion picture contained in the first data, and 

said predetermined process involves making said display device output the second data 
related to the object recognized. 

68. (CURRENTLY AMENDED) FfAHThe storage medium readable by a machine 
tangible embodying a program according to claim 67, wherein the second data contains an 
image related to the motion picture of the first data, 

69. (CURRENTLY AMENDED) ffAllThe storage medium readable by a machine 
tangible embodying a program according to claim 67, wherein the second data is multiplexed 
with the first data and thus distributed. 

70. (CURRENTLY AMENDED) f [A HThe storage medium readable by a machine 
tangible embodying a program according to claim 69, wherein the first data is constructed with a 
predetermined data structure and the second data is embedded in a margin formed in the data 

71 . (WITHDRAWN) The storage medium readable by a machine tangible embodying 
a program according to claim 66, wherein the predetermined process is an execution of an 
application program related to the object recognized, 

72. (WITHDRAWN) The storage medium readable by a machine tangible embodying 
a program according to claim 66, wherein the predetermined process is an execution of a task 
related to the object recognized. 

73. (WITHDRAWN) The storage medium readable by a machine tangible embodying 
a program according to claim 66, wherein said predetermined process involves commanding, via 
said communication unit, other task executing device to execute a task related to the object 
recognized. 
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74. (CURRENTLY AMENDED) \\A HThe storage medium readable by a machine 
tangible embodying a program according to claim [[46]]66, wherein said display device includes 
a reproducing unit reproducing the motion picture recorded on a recording medium, 

said recording medium is recorded with a first motion picture and a second image related 
to an object corresponding to the first motion picture, and 

said predetermined process involves reproducing from said recording medium the 
second image related to the object recognized and making said display device display the 
reproduced second image, 

75. (WITHDRAWN) The storage medium readable by a machine tangible embodying 
a program according to claim 66, wherein said server further includes a unit transmitting the 
information to an add-up device adding up the pieces of information, and 

said predetermined process involves notifying said server of the information on the object 
recognized, and making said add-up device add up results of the recognition via said server. 

76. (CURRENTLY AMENDED) [[A II The storage medium readable by a machine 
tangible embodying a program according to claim 66, further comprising reproducing the motion 
picture recorded on said recording medium, 

wherein said transmitting involves, when the motion picture to be reproduced receives 
the pointing manipulation, transmitting, to said server, information for specifying this motion 
picture and information for specifying a position where the pointing manipulation is effected on 
the motion picture, 

77. (ORIGINAL) A storage medium readable by a machine, tangible embodying a 
program of instructions executable by the machine including a communication unit so as to 
operate in linkage with a display device including a receiving unit receiving data containing a 
motion picture, a display unit displaying the motion picture, and a pointing unit pointing a position 
on the motion picture, to perform method steps comprising: 

receiving information on the position where the pointing manipulation is effected from 
said display device; 

recognizing the object in the motion picture receiving the pointing manipulation on the 
basis of the information received from said display device; and 

executing a predetermined process related to the object recognized. 
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78. (CURRENTLY AMENDED) [[A H The storage medium readable by a machine 
tangible embodying a program according to claim 77, wherein said predetermined process 
further includes transmitting an information on the object recognized to said display device, 

79. (WITHDRAWN) The storage medium readable by a machine tangible embodying 
a program according to claim 77, wherein the predetermined process is an execution of a task 
related to the object recognized, 

80, (WITHDRAWN) The storage medium readable by a machine tangible embodying 
a program according to claim 77, wherein said predetermined process involves commanding 
other task executing device to execute a task related to the object recognized via said 
communication unit, 

81 , (WITHDRAWN) The storage medium readable by a machine tangible embodying 
a program according to claim 77, wherein said predetermined process involves notifying an add- 
up server for adding up pieces of information, of the information on the object recognized, and 
making said add-up server add up results of the recognition, 

82. (WITHDRAWN) The storage medium readable by a machine tangible embodying 
a program according to claim 77, wherein said communication unit communicates with an E-mail 
server delivering an E-mail, and 

said predetermined process involves commanding said E-mail server to deliver an E-maii 
related to the object recognized via said communication unit. 

83, (ORIGINAL) A storage medium readable by a machine, tangible embodying a 
program of instructions executable by the machine including a communication unit so as to issue 
a command to a data distribution system in linkage with a display device including a receiving 
unit receiving data containing a motion picture from said data distribution system, a display unit 
displaying the motion picture and a pointing unit pointing a position on the motion picture, to 
perform method steps comprising: 

receiving information on the position where the pointing manipulation is effected on the 
motion picture; 

recognizing the object in the motion picture receiving the pointing manipulation on the 
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basis of the information received from said display device; 
referring to an instruction related to the object; and 

commanding said data distribution system to change over the data to be distributed in 
accordance with the instruction, 

84-108, (CANCELLED) 

109. (CURRENTLY AMENDED) A control method of controlling a display device 
including a display unit displaying a motion picture and a pointing unit pointing a position on the 
motion picture, said method comprising: 

recognizing an object in the motion picture on which the pointing manipulation is effected; 

and 

executing a predetermined process related to the object recognized, 
wherein said predetermined process involves, when the object is recognized from the 
pointing manipulation during the display of the motion picture contained in the first data, 
commanding said display device to effect a first changeover to an output of the second data 
related to the object, 

said predetermined processing involves commanding said display device to execute a 
second changeover to displaying the motion picture after outputtinq the second data, and 

A control m e thod accord i ng to slaim 108, wh e r e in said display device further includes a 
recording unit recording data, and said predetermined processing [[step]]involves issuing a 
command of displaying the motion picture from a point of the first change over recorded on said 
recording unit after outputting the second data. 

110. (CANCELLED) 

111 . (ORIGINAL) A control method of controlling a display device including a display 
unit displaying a motion picture and a pointing unit pointing a position on the motion picture, said 
method comprising: 

transmitting the position on the motion picture receiving the pointing manipulation to a 
server including a recognizing unit recognizing an object in the motion picture receiving the 
pointing manipulation; 

receiving, from said server, information on the object in the motion picture recognized by 
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said server; and 

executing a predetermined process related to the object recognized . 


112. (CURRENTLY AMENDED) [[A IIThe control method according to claim 111, 
wherein said display device further includes a receiving unit receiving data, 

said receiving unit receives first data containing the motion picture, and second data 
related to the object in the motion picture contained in the first data, and 

said predetermined process involves making said display device output the second data 
related to the object recognized. 

113. (CURRENTLY AMENDED) f[A IIThe control method according to claim 112, 
wherein the second data contains an image related to the motion picture of the first data. 

114. (CURRENTLY AMENDED) f [A IIThe control method according to claim 112, 
wherein the second data is multiplexed with the first data and thus distributed, 

115. (CURRENTLY AMENDED) \\A IIThe control method according to claim 114 T 
wherein the first data is constructed with a predetermined data structure and the second data is 
embedded in a margin formed in the data structure of the first data . 

116. (WITHDRAWN) The control method according to claim 111 , wherein the 
predetermined process is an execution of an application program related to the object 
recognized. 

117. (WITHDRAWN) The control method according to claim 111 1 wherein the 
predetermined process is an execution of a task related to the object recognized. 

118. (WITHDRAWN) The control method according to claim 111 t wherein said 
predetermined process involves commanding, via said communication unit, other task 

executing device to execute a task related to the object recognized. 

119. (CANCELLED) 
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120, (WITHDRAWN) The control method according to claim 111, wherein said server 
further includes a unit transmitting the information to an add-up device for adding up the pieces 
of information, and 

said predetermined process involves notifying said server of the information on the object 
recognized, and making said add-up device add up results of the recognition via said server 

121, (CURRENTLY AMENDED) ffAllThe control method according to claim 111, 
further comprising reproducing the motion picture recorded on recording medium, 

wherein said transmitting involves, when the motion picture to be reproduced receives 
the pointing manipulation, transmitting, to said server, information for specifying this motion 
picture and information for specifying a position where the pointing manipulation is effected on 
the motion picture, 

122, (ORIGINAL) An information processing method for a computer including a 
communication unit to operate in linkage with a display device including a receiving unit 
receiving data containing a motion picture, a display unit displaying the motion picture, and a 
pointing unit pointing a position on the motion picture, said method comprising: 

receiving information on the position where the pointing manipulation is effected from 
said display device; 

recognizing the object in the motion picture receiving the pointing manipulation on the 
basis of the information received from said display device; and 

executing a predetermined process related to the object recognized , 

123, (CURRENTLY AMENDED) [[An ]]The information processing method according 
to claim 122, wherein said predetermined process further includes transmitting an information on 
the object recognized to said display device. 

124, (WITHDRAWN) The information processing method according to claim 122 , 
wherein the predetermined process is an execution of a task related to the object recognized, 

125, (WITHDRAWN) The information processing method according to claim 122, 
wherein said predetermined process involves commanding, via said communication unit, other 
task executing device to execute the task related to the object recognized. 
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126. (WITHDRAWN) The information processing method according to claim 122, 
wherein said predetermined process involves notifying a ad-up server adding up pieces of 
information, of the information on the object recognized, and making said add-up server add up 
results of the recognition. 

127. (WITHDRAWN) The information processing method according to claim 122, 
wherein said communication unit communicates with an E-mail server delivering an E-mail, and 

said predetermined process involves commanding said E-mail server to deliver an E-mail 
related to the object recognized via said communication unit 

128. (ORIGINAL) An information processing method for a computer including a 
communication unit to issue a command to a data distribution system in linkage with a display 
device including a receiving unit receiving data containing a motion picture from said data 
distribution system, a display unit displaying the motion picture and a pointing unit pointing a 
position on the motion picture, said method comprising: 

receiving information on the position where the pointing manipulation is effected on the 
motion picture; 

recognizing the object in the motion picture receiving the pointing manipulation on the 
basis of the information received from said display device; 
referring to an instruction related to the object; and 

commanding said data distribution system to change over the data to be distributed in 
accordance with the instruction, 

129-135, (CANCELLED) 
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